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A method for pacing data flows in 
packet switched netwoiics by arranging data 
transmission over a period of time based upcm 
a set of ascertainable factors about the under- 
lying transmission link to derive an interseg- 
ment transmission interval. The inicrscgmcni 
transmission interval can be used to pace ei- 
ther data packets or acknowledgment packets. 
The method is especially useful icx pacing the 
transmission of data in a digital data packet 
communication environment having a plural- 
ity of digital packet transmission stations in- 
ter-connectable in a data path and employ- 
ing the Transmission Control Protocol (TCP) 
suite. 
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METHOD FOR PACING DATA FLOW IN 
A PACKET-BASED NETWORK 

CROSS-REFERENCE TO RELATED APPUCATIONS 

This application claims priority from the following U.S. Provisional 
Application, the disclosure of which, including ail appendices and all attached 
documents, is incorporated herein by reference in its entirety for all purposes: 

U.S. Provisional Patent Application Serial No. 60/051,387, in the name of 
Robert L. Packer and Brett D. Galloway, entitled, "A Method for Pacing Data Flow in a 
Network Employing a TCP/IP Protocol Suite", filed July 1, 1997. 

Further, this application makes reference to the following conunonly 
owned U.S. Patent Applications, which are incorporated herein by reference in their 
entirety for all purposes: 

Co-pending U.S. Patent Application Serial No. 08/762,828, now U.S. Pat, 

No. in the name of Robert L. Packer, entitled "Method for Rapid Data Rate 

Detection in a Packet Commtmication Environment Without Data Rate Supervision;" 

Co-pending U.S. Patent Application Serial No. 08/970,693, in the name of 
Robert L. Packer, entitled "Method for Minimizing Unneeded Retransmission of Packets 
in a Packet Communication Environment Supporting a Plurality of Data Link Rates;** and 

Co-pending U.S. Patent Application Serial No. 08/742,994, in the name of 
Robert L. Packer, entitled ''Method for Explicit Data Rate Control in a Packet 
Commimication Environmem Without a Data Rate Supervision." 

BACKGROUND OF THE INVENTION 
The present invention relates to digital packet transmission, and 
particularly to methods for pacing transmissions of data within time intervals that are 
based on criteria ascertainable from the characteristics of the underlying transmission 
infrastructure. Embodiments according to the present invention are particularly useful in 
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conjunction with data flow rate detection and control of a digitally-switched packet 
telecommunications environment that is not subject to explicit data flow rate control. 

The ubiquitous TCP/IP protocol suite implements the world wide data 
communication network environment called the Internet and is also used in private 
networks (e.g.. Intranets). TCP is the transport level Transmission Control Protocol and 
IP is the network level Internet Protocol. At the network level, IP provides a datagram 
delivery service. At the transport level built on top of die datagram delivery service, 
TCP provides guaranteed sequential delivery of a data stream between two hosts 
operating with IP protocol. 

TCP provides for a reliable session-based service for delivery of 
sequenced packets of information across the Internet. One method employed to provide 
this reliable service is a system of acknowledgments for data received at each endpoint. 
However, data segments and acknowledgments can be lost. To address this problem, 
TCP uses a retransmission timeout (RTO) mechanism. Under the RTO mechanism. TCP 
manages a retransmission timer for each connection. After an endpoint sends data, it 
expects acknowledgment from the receiving endpoint. TCP sets the retransmission timer 
and tracks an RTO value and a round trip time (RTT) for the connection. A round trip 
time is the time elapsed between the start of transmission of a TCP-type data segment 
and the receipt of an acknowledgement of that segment. If an acknowledgment is not 
received by the time the retransmission timer expires, a transmission loss is inferred and 
TCP retransmits the data. 

Other terms used hereinafter are defli^d as follows. 
A TCP connection is a well-understood communication mode in which two 
end users of the TCP protocol are able to be guaranteed that the exchanged data is in 
sequence and accurate at the end-user level, even though the TCP connections may not 
have received the data in sequence or accurately. 

Transmission delay is the amount of time required to serialize the bits on 
the transmission media, and does not include propagation delay or queueing delay. 

A window transmission time (WTT) is the time required to transmit a TCP 
flow conn-ol window's worth of data, where the ''time required to transmit" is equal to 
the transmit delay. 

A "segment is a transport PDU (protocol data unit), such as in TCP, 
encapsulated within a networic "packet." 
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The number of segments in a flow control window (NSW) is the size of 
the TCP flow control window (in bytes) divided by the maximum segment size (MSS) (in 
bytes) as defined by the TCP protocol. 

Aside from the system of acknowledgements, the TCP/IP protocol 
intentionally omits explicit supervisory function over the rate of data transport over the 
various media that make up the network. While there are certain perceived advantages, 
this characteristic has the consequence of juxtaposing very high-speed packet flows and 
very low-speed packet flows in potential conflict for network resources, which results in 
inefficiencies. At the extreme, certain pathological loading conditions can result in 
instability, overloading, and data transfer stoppage. The loading conditions can be 
created by processes that generate traffic in bursts of data packets called "packet trains." 

TCP "flow control" mechanisms attempt to alleviate the loading conditions 
by limiting the rate at which a TCP endpoint can emit data. A "flow", as used in the 
context of TCP/IP networic traffic, is defined as traffic between a specific pair of IP 
host/port addresses (e.g., a TCP connection or a UDP session). A basic flow control 
mechanism in TCP is a "sliding window" that limits the amount of unacknowledged 
transmit data that a transmitter can emit. Another flow control mechanism is a 
"congestion window" (which is a refinement of the sliding window) that involves a 
conservative expansion to make use of the full, allowable window. A component of this 
mechanism is sometimes referred to as "slow start". These window flow control 
mechanisms woric m conjunction with the retransmit timeout mechanism described above 
to provide a limited level of end-to-end data flow rate control. However, these 
mechanisms do not provide explicit rate control of data flow in any particular connection 
in the networic. 

TCP "congestion control" is another mechanism that is related to "flow 
control". Congestion control in TCP/IP networks is accomplished by a combination of 
TCP end systems and routers that queue and discard packets when a certam congestion 
threshold is exceeded. Packet discarding serves as a feedback mechanism to a TCP 
transmitter to indicate that congestion exists. One disadvantage of this feedback 
mechanism is the possibly large and uneven delays that may be perceptible to interactive 
users at the TCP end systems. 
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Besides providii^ congestion control, routers typically support various 
queuing methods intended to provide fairness and a rough ability to partition and 
prioritize separate classes of data traffic. An increasingly common method of queuing 
implemented in access-link routers, interior routers, and ATM backbone equipment is the 
"Fair Queuing" technique. In Fair Queuing, when the number buffered packets pending 
transmission reaches a predetermined congestion threshold, packets are discarded on the 
basis of whether or not other packet(s) is already buffered for the specific flow associated 
with tliose packets. Fair Queuing beneficially limits flows that may have high bandwidth 
demands when a router becomes congested. However, Fair Queuing also implicitly (and 
unintendedly) has a tendency to discard packets for flows that emit packets in a "bursty'' 
fashion (i.e., packet trains, as described below). Bursty traffic is generally characterized 
by long period of inactivity punctuated by a large burst of data traffic. "Bursty" packets 
affect the conventional congestion and flow control mechanisms. As packet trains 
traverse through the network, they induce queuing in a way that increases the probability 
of packet loss in routers using Fair Queuing mechanisms, resulting in undesired 
inefficiencies due to the discarding of packets. Packet loss subsequently causes a 
retransmission timeout and retransmission of another packet train, which results in 
further inefficiencies and adds to the congestion control problem. 

Therefore, it is desirable to provide a mechanism to increase efficiency of 
data transfer while reducing the risk of daU loss of bursty packet traffic. 

SUMMARY OF THE INVENTION 
According to the invention, in a packet switched network, the frequency of 
data transmissions during a window transmission time (WTT) is arranged based upon a 
set of ascertainable factors about the underiying transmission link so that data flow can 
be paced. Specifically, calculated interpacket tune intervals are inserted among bursts of 
packets. The interpacket transmission intervals are used to pace either the transmission 
of data packets or the transmission of acknowledgment packets. According to an 
embodiment of the present invention in a TCP/IP environment, packets are paced 
according to window transmission time (WTT), round trip time (RTT) and number of 
segments in a flow control window (NSW) and specifically according to the followmg 
relation: 

m = (RTT-WTT)/(NSW-1) 
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where an ITI is the intersegment transmission interval (an elapsed lime); 
and RTT>WTT and NSW>1. 

This embodiment is especially useful for pacing transmission of data in a 
digital data packet communication environment having a plurality of digital packet 
transmission stations inter-connectable in a data path employing the Transmission Control 

Protocol (TCP) suite. 

In another embodiment, data flow pacing by the insertion of interpacket 
gaps can be accomplished by placing a predetermined rate limit on the data flows. This 
technique is especially useful for pacing packet trains that may arise from sources other 
than a windowed flow control protocol or sources that emit large bursts of packets. 
This technique is also suited for a windowed flow control protocol where the RTT is less 
than the WTT, a window's worth of packets. 

In yet another embodiment, pacing by the insertion of interpacket gaps, 
i.e., intersegment time intervals (ITI) can also be accomplished by controlling die 
acknowledgement process. For example, a device can be interposed between a sender 
and a receiver in the network. This device controls the rate and scope of 
acknowledgment (ACK) packets so that data is paced in the network. 

The interpacket gap insertion-type data flow pacing techniques according 
to the invention can be combined with other transmission techniques in select 
embodiments. For example, in various alternative embodiments, data flow pacing 
techniques can be combined with techniques for automatic scheduling of packets for 
transmission, techniques for providing rate control (i.e., using acknowledgements), 
techniques for reducing unnecessary retransmissions as well as various other techniques. 

Some embodiments according to the present invention can provide 
improved link efficiency. Certain embodiments according to the present invention may 
reduce queuing delay. Many embodiments according to the invention can reduce 
network coi^estion and prevent packet loss. 

The invention will be better understood upon reference to the following 
detailed description and its accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig, 1 depicts a representative inter-network having a plurality of clients 
and a plurality of servers that process data flows; 

Fig. 2 A depicts a representative conventional unpaced bursty packet data 

flow; 

Fig. 2B depicts a representative paced bursty packet data flow according to 
a particular embodiment wherein a window's worth of packets is paced over the flow's 
RTT; 

Fig. 3 depicts a key operation according to the invention; 
Fig. 4 depicts the various layers that make up the Transmission Control 
Protocol/Internet Protocol (TCP/IP) suite. 



DESCRIPTION OF SPECIHC EMBODIMENTS 

Introduction 

The present invention provides techniques to manage networic bandwidth, 
such as on a transmission link between a local area network (LAN) and a wide area 
network (WAN), by controlling the introduction of packets onto the transmission link. 
More specifically, the invention involves techniques for introducing interpacket delays in 
bursty-type packet transmissions, and in particular in TCP/IP protocol environments. 

Network Overview 

Fig. 1 depicts an inter-network of a plurality of clients and a plurality of 
servers that process data flows through a wide area network (WAN). The clients and 
servers are described below. In Fig. 1, first network 60 is shown as a Token Ring or a 
frame oriented network, although other networks can also be used. Network 60 links 
together hosts 61, 62. and 63. Hosts 61, 62, and 63 can generally be any computer 
running any operating system. Network 60 is inter-networked to a wide area network 
71 through a first router 75 and a second router 175 to a second network 70. The 
system gateway of routers 175 and 75 can also include a firewall, a network bridge, and 
other feanires not relevant to the invention but important to operation. Network 70 
(shown m Fig. 1 as an Ethernet networic) links hosts 71 and 72. Hosts 71 and 72 can 
also be any computer rurming any operating system. 
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Router 75 is a network access point (NAP) of networks 60 and 70. As 
shown in Fig. 1, router 75 employs a Token Ring adapter and an Ethernet adapter. This 
enables router 75 to interface with the two heterogeneous networks 60 and 70. 

The present invention can be practiced in a client-server environment, but 
the client-server environment is not essential. In a specific embodiment, the subject 
invention dwells in bridges 72, 73 between each of the networks 60 and 70 and each of 
the routers 75, 175. However, the elements may reside in the end systems, in the 
routers or in the links between the routers and the WAN. In general , the invention can 
be placed wherever the traffic can be paced. The term "server," as used herein, refers to 
a unit that performs one or more of the following functions: receiving queries from 
(typically, remote) clients, performing processing necessary to formulate responses to the 
queries, providing these responses to the clients, and performing other necessary tasks. 
A server may also act in the capacity of a client for a response (i.e., when it accesses 
remote databases located at another node) while it acts as a server for another response 
(i.e., when acting as a database server). 

Transmission Delav and RTT Determination 

The pacing of data flows is based, in part, on (1) transmission delay and 
(2) RTT. The transmission delay and RTT of a link can be determined by numerous 
methods. A technique for automatically determining the transmission delay and RTT of 
a TCP connection is disclosed in the aforementioned co-pending U.S. Patent Application 

Serial No. 08/762,828 filed December 6, 1996, now U.S. Pat. No. , which is 

incorporated herein by reference. 



Data Flow Pacing 

Fig. 2A depicts a conventional unpaced data flow. In conventional sliding 
window protocols (i.e., as defmed by TCP), transmission of a window of segments 
within individual flows are compressed in the front of the flow's RTT where RTT > 
WTT. A sender 230 transmits packets 232 each containing a segment, as capacity 
becomes available on the transmission link, beginning at time 1 and ending at time 3, to 
a receiver 238. Upon receipt of the first packet 232a, receiver 238 sends an 
acknowledgement packet 234 back to sender 230, which is received at time 2. The 
round trip time (RTT) is defmed as the time between receipt of acknowledgement packet 
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234 (Time 2) and the lime of transmission of the first packet 232a (Time 1) (or RTT = 
Time2 - Timel). The window transmission time (WTT) is defined as the time between 
the beginning of transmission of the first packet 232a (Time 1) and the end of 
transmission of the last packet 232d (Time 3) (or WTT = Time3-Timel). Typically, the 
subsequent transmission of data segments 236, i.e., the next window, is not transmitted 
until acknowledgement packet 234 is received. 

The pacing of packet trains of an entire RTT of a particular flow in the 
present invention involves spacing out a window's worth of packets over an entire RTT. 
The data flow pacing of the present invention can be implemented by various 
embodiments, some of which are described below. However, modifications and 
additions to the embodiments described below are also within the scope of the present 
invention. 

Pacing Based upon Round Trin Time (RTT) 

Fig. 2B depicts a packet flow in a representative client server connection 
in an embodiment wherein a window's worth of packets is spaced out over the flow's 
RTT. As shown in Fig. 2B, data flow pacing is accomplished by an intermediate pacer 
250 based on the RTT value that is computed using one of the embodiments discussed 
above. The implementation of pacer 250 is described below. Initially, pacer 250 
receives a first packet 242a from sender 240 and transmits this packet 244a to a receiver 
260. Upon receivii^ additional packets 242b through 242n, pacer 250 determines the 
number of packets to be transmitted and the remaining time within the present RTT 
interval. 

In one embodiment according to the invention, the remaining packets 242b 
through 242n are transmitted by pacer 250 at approximately "equally" spaced time 
intervals, as shown in Fig. 2B. Pacer 250 determines the number of packets to be 
transmitted and the remaining time left in this RTT interval. Pacer 250 then divides the 
remaining time into the number of packets to obtain a time interval according to the 
formula 

m = (RTT-WTT)/(NSW-1) 

where an ITI is the intersegment transmission interval (an elapsed time); 

and 

RTT>WTTandNSW>l. 
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One packet is then transmitted at each interval. This embodiment results 
in the transmission of the burst of packets received at Timel over the RTT link. 

A variety of embodiments based upon these techniques can be realized 
without departing from the scope of the present invention. For example, in certain 
embodiments, the RTT can be updated continually or periodically as additional 
information about the state of the network is learned. Tlie time inten'al can then be 
recomputed accordingly. In other embodiments, two or more packets can be transmitted 
within each time interval (and the time interval can be increased accordingly). 
Generally, any number of packets can be transmitted within a time interval having any 
duration. Furthermore, the packet transmissions can be spaced evenly or randomly 
within the time interval. Random spacing would decrease autocorrelation effects and 
decrease queuing delay, thus reducing end-to-end delay. 

Pacer 250 can be designed to receive the burst of packets, buffer the 
packets, and transmit packets at selected times. Pacer 250 can be implemented as a 
stand-alone unit or incorporated within the design of the sender. Select embodiments 
realize Pacer 250 using a processor, a microcontroller, an application specific integrated 
circuit (ASIC), a programmable device, or any other device designed and operated to 
provide tlie functionality described herein. A flow chart of a key operation of the pacer 
250 is shown in Fig. 3, as hereinafter explained. 

Pacing Based upon Round Trio Time (RTT) 

In one embodiment of the pacer 250, RTT may be estimated by round trip 
delay, as for example taught in the aforementioned patent application. Fig. 3 depicts a 
representative flowchart 301 of process steps that may be included in many embodiments 
according to the method for pacing transmission of data of the present invention. In a 
step 302, a round trip time (RTT) value is determined. Next, in a step 304, the number 
of segments in a window is determined. Then, in a step 306, interpacket gaps or 
intersegment transmission time intervals are computed, typically according to the formula 
herein above based on RTT, WTT and NSW. In a step 308, the interpacket gap is 
inserted between each one or selected packets in the window as each one of the packets 
is transmitted, as illustrated in Fig. 2B. If upon testing (Step 309) there are further 
packets, the process is repeated, either from the beginning of tl» determination of the 
roundtrip time or from the beginning of step 308; otherwise the process ends. The round 
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trip time may typically be determined only once per connection. However, all values 
could be computed more frequently if it is found that the round trip time or the window 
transmission time or the number of segments per window vary during a connection for 
any reason of design or environmental conditions. 

5 

Pacing Based upon Predetermined Rate Limit 

In another embodiment, pacing can be accomplished by placing a 

predetermined rate limit on the data flows. This technique is especially useful for packet 
10 trains that may arise from sources other than a windowed flow control protocol or 

sources that emit large burst of packets. This technique is also suited for a windowed 

flow control protocol where the RTT is shorter than the time required to transmit a 

window's worth of packets, thereby necessitating the need to buffer, discard, or limit the 

transmission of some of the packets. 
15 The relation between the arbitrary rate limit and the determination of m 

is as follows: 

The arbitrary rate limit is used to derive an effective RTT using the 
formula: (AR) = (WB)/(RTT), where (AR) is Arbitrary Rate, (WB) is the number of 
bits in a flow control window or Window Bits and (RTT) is as defined as round trip 
20 time. Hence, RTT in seconds is (WB)/(AR). For example for an arbitrary rate of 32K 
bps with a window of BKBytes or 64Kbits, the RTT to be used for calculation is 2 
seconds. 

In still another embodiment using this technique, each sender sends the 
burst of packets to an intermediate pacer, similar to pacer 250 in the above embodiment. 
25 The pacer 250 then determines the number of packeits thai can be transmitted within the 
current RTT interval or even an arbitrary interval. The pacer 250 then transmits the 
packets in one of the manners described above. 

Pacing Based upon Control of Acknowledgement Packets 
30 In yet another embodiment, pacing can also be accomplished by 

controlling die TCP acknowledgement process. For example, a rate control device can 
be interposed between the sender and the receiver. This device controls the rate and 
scope of acknowledgment (ACK) packets in the manner described in detail in the 
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aforementioned co-pending U.S. Patent Application Serial No. 08/762,828. By 
controlling the rate of acknowledgments, there is explicit conttol of the intervals in which 
a transmitter receives acknowledgments, i.e., the roundtrip time for each 
acknowledgment is explicidy controlled. 

5 

Additional Embodiments 

Additional embodiments can incorporate select data flow pacing techniques 
described above for improved performance. For example, techniques for automatic 
scheduling of TCP packets for transmission can be coupled with data flow pacing 
10 techniques to maximize usage, reduce transmission delay, and reduce congestion on the 
transmission medium. A technique for automatically schedulmg TCP packets for 
transmission is disclosed in die aforementioned co-pending U.S. Patent Application Serial 
No. 08/742,994. 

As another example, techniques for providing TCP rate control (i.e., using 
15 acknowledgements) can also be coupled with data flow pacing techniques to improve 
efficiency and reduce congestion. 

Lavers of TCP/IP Protocol 

Fig. 4 depicts the various layers that make up the Transmission Control 

20 Protocol/Internet Protocol (TCP/IP) suite. A physical layer 80 is the base layer of the 
TCP/IP suite that defines the mechanical, electrical, functional, and procedural standards 
for die physical transmission of data over communications media, (e.g., a network 
connection). Physical layer 80 can include electrical, mechanical, and ftmctional 
standards. The functional standards can indicate whether a network is (1) packet 

25 switching or frame-switching, and (2) based on a Carrier Sense Multiple 
Access/Collision Detection (CSMA/CD) or a frame relay paradigm. 

A data link layer 82 overlies physical layer 80. Data link layer 82 
provides the functions and protocols to transfer data between network resources and to 
detect errors that may occur at the physical layer. Operating modes at data link layer 82 

30 include such standardized network topologies as IEEE 802.3 Ethernet, IEEE 802.5 
Token Ring, ITU X.25, or serial (SUP) protocols. 

Network layer protocols 84 overlay data link layer 82 and provide tte 
means for establishing connections between networks. The standards of network layer 
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protocols provide operational control procedures for internetworking communications and 
routing information through multiple heterogeneous networks. Examples of network 
layer protocols are the Internet Protocol (IP) and the Internet Control Message Protocol 
(ICMP). The Address Resolution Protocol (ARP) is used to correlate an Internet address 
and a Media Access (MAC) address for a particular host. The Routing Information 
Protocol (RIP) is a dynamic routing protocol for passing routing information between 
hosts on networks. The ICMP is an internal protocol for passing control messages 
between hosts on varioxis networks. ICMP messages provide feedback about events in 
the network environment or can help determine if a path exists to a particular host in the 
network environment. The latter is called a "Ping". IP provides the basic mechanism 
for routing packets of information in the Internet. IP is a non-reliable communication 
protocol that provides a "best efforts" delivery service. IP does not commit network 
resources to a particular transaction, perform retransmissions, nor give 
acknowledgments . 

Transport layer protocols 86 provide end-to-end transport services across multiple 
heterogeneous networks. A User Datagram Protocol (UDP) provides a connectionless, 
datagram oriented service that provides a non-reliable delivery mechanism for streams of 
information. TCP provides a reliable session-based service for delivery of sequenced 
packets of information across the Internet. TCP provides a connection oriented reliable 
mechanism for information delivery. 

Conclusipq 

The present invention provides methods for pacing data packet 
transmissions in data packet based telecommunications systems. The previous description 
of the specific embodiments is provided to enable any person skilled in the art to make 
or use the present invention. The various modifications to these embodiments will be 
readily apparent to those skilled in the art, and the generic principles defined herein may 
be applied to other embodiments without the use of the inventive faculty. Accordingly, 
the drawings and detailed description are to be regarded as ilhistrative in namre and not 
as restrictive. Thus, the present invention is not intended to be limited to the 
embodiments shown herein but is to be accorded the widest scope consistent with the 
principles and novel features disclosed herein, and as indicated by the appended claims. 
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WHAT IS CLAIMED IS : 

1 1. A method for pacing transmission of data in a packet communication 

2 environment having a plurality of transmission stations inter-connectable via a link 

3 through a wide area network cloud, said method comprising the steps of: 

4 determining a round trip time for a packet issued by a transmitter and 

5 acknowledged by a receiver; 

6 determining number of data segments in a flow control window; 

7 determining a window transmission time as the amount of time required 

8 to transmit the data segments of the flow control window; 

9 computing an intersegment transmission interval based on the round trip 

10 time, window transmission time and number of segments per flow control window; and 

1 1 during a communication connection 

12 successively transmitting packets, each containing a data segment, with 

13 intersegment transmission intervals between selected packets. 

1 2. The method of claim 1 wherein the round trip time determining step 

2 comprises the steps of: 

3 sending a first packet to a remote transmission station; 

4 receixdng a second packet as an acknowledgment from the remote 

5 transmission station; 

6 measuring a time delay between the first packet and the second packet; 

7 and 

8 computing the round trip time from the time delay. 

1 3. The method of claim 1 wherein the intersegment transmission interval 

2 is randomly varied from its computed value during the transmitting step. 

1 4. The method of claim 1 wherein the round trip time determining step 

2 is effected only once in conjunction with a single coimection. 

1 5. The method according to claim 1 wherein said intersegment 

2 transmission interval establishes a delay bound for scheduling of packets for 

3 transmission. 
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1 6. The method of claim I mcluding a further step of recomputing the 

2 intersegment transmission interval upon a change of any one of round trip time, window 

3 transmission time and number of segments per window. 

1 7. The method according to claim 1 wherein any one of said 

2 determining steps is effected prior to said first transmitting step. 

1 8. The method according to claim 1 wherein said round trip time (RTT) 

2 determining step includes computation based on an arbitrary rate (AR) according to the 

3 relation: (RTT) = (WB)/(AR), where (WB) is number of bits in a flow control window, 

4 in order to compute said intersegment transmission interval. 

1 9. The method according to claim 1 wherein said intersegment 

2 transmission interval computing step comprises a computation according to the relation: 

3 ITI=(RTT-\VTT)/(NSW-1) 

4 where 

5 RTT is round trip time, 

6 WTT is window transmission time, 

7 NSW is number of segments per window, 

8 RTT>WTT, and 

9 NSW>1, 

1 10. A method for pacing transmission of data in a packet conmiunication 

2 environment having a plurality of transmission stations inter-connectable via a link 

3 through a wide area network cloud, said method comprising the steps of: 

4 determining a round trip time for a packet issued by a transmitter and 

5 acknowledged by a receiver, 

6 determining number of data segments in a flow control window; 

7 determining a window transmission time as the amount of time required 

8 to transmit the data segments of the flow control window; 

9 computing an intersegment transmission interval based on the round trip 

10 time, window transmission time and number of segments per flow control window; and 

1 1 during a commimication connection. 
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12 successively transmitting packets, each containing an acknowledgment of 

13 receipt of data, with intersegment transmission intervals between selected packets. 

1 11. The method of claim 10 wherein the round trip time determining 

2 step comprises the steps of: 

3 sending a first packet to a remote transmission station; 

4 receiving a second packet as an acknowledgment from tlie remote 

5 transmission station; 

6 measuring a time delay between the first packet and the second packet; 

7 and 

8 computing the round trip time from the time delay. 

1 12. The method of claim 10 wherein the intersegment transmission 

2 interval is randomly varied from its computed value during the transmitting step. 

1 13. The method of claim 10 wherein the round trip time determining 

2 step is effected only once in conjunction with a single connection. 

1 14. The method according to claim 10 wherein said intersegment 

2 transmission interval establishes a delay bound for scheduling of packets for 

3 transmission. 

1 15. The method of claim 10 including a further step of recomputing the 

2 intersegment transmission interval upon a change of any one of round trip time, window 

3 transmission time and number of segments per window. 

1 16, The method according to claim 10 wherein any one of said 

2 determining steps is effected prior to said first transmitting step. 

1 17. The method according to claim 10 herein said round trip time 

2 (RTT) determining step includes computation based on an arbitrary rate (AR) according 

3 to the relation: (RTT) = (WB)/(AR), where (WB) is number of bits in a flow control 

4 window, in order to compute said intersegment transmission interval. 
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1 18. The method according to claim 1 wherein said intersegment 

2 transmission interval computing step comprises a computation according to the relation: 

3 ITI=(RTT-WTT)/(NSW-1) 

4 where 

5 RTT is round trip time, 

6 WTT is window transmission time, 

7 NSW is number of segments per window, 

8 RTT>WTT, and 

9 NSW>1. 
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